Libraries tagged by web crawling
duzun/hquery
90979 Downloads
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies. PHP5+
crwlr/crawler
2880 Downloads
Web crawling and scraping library.
crwlr/robots-txt
5397 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
cleantalk/anti-ddos-lite
797 Downloads
A small PHP app to protect your site against DDoS attack or crawling web site by bots.
crawlzone/crawlzone
5011 Downloads
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.
proclnas/curl-rox
17 Downloads
Just another curl wrapper for webCrawling purposes
laurentvw/scrapher
2510 Downloads
A web scraper for PHP to easily extract data from web pages
laurentvw/lavacrawler
94 Downloads
A web scraper for PHP to easily extract data from web pages
mehrabx/web-crawler
1 Downloads
A web crawler package
matheusfaustino/phrawl
3 Downloads
A web crawling framework in PHP
gavinggordon/sorcerer
17 Downloads
An easy-to-use PHP class for scraping webpages' source code.
biberltd/crawler-bundle
137 Downloads
Crawles web pages
proclnas/curl-rox-volatile
1 Downloads
Just another curl wrapper for webCrawling purposes (pthreads modified)
gyaaniguy/pcrawl
8 Downloads
PHP web scraping and crawling library. With support for multiple clients, fast parsing, debugging and on the fly changes to various options
snippetify/snippet-sniffer
9 Downloads
Crawling and scraping web pages to extract snippets